"The highlighted tokens are predominantly Japanese grammatical particles, auxiliary verbs, and function words that serve as syntactic connectors or markers of case, topic, or relation within sentences. These include particles like \"は\", \"の\", \"に\", \"を\", \"で\", \"が\", as well as common auxiliary forms and punctuation. Their frequent activation reflects their essential role in structuring Japanese sentences and conveying grammatical relationships."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.62 | 0.929 | 0.26 | 0.406 | 0.26 | 0.98 | 0.02 | 0.74 |
fuzz | 0.71 | 1.0 | 0.42 | 0.592 | 0.42 | 1.0 | 0.0 | 0.58 |